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MANIPULATING CONTENT OBJECTS TO CONTROL THEIR DISPLAY 

[0001] This application is a continuation-in-part application of United States 

Patent Application Serial No. 09/660,991, entitled "Peer-to-Peer Video Precaching" filed 
September 13,2000. 

FIELD OF THE INVENTION 

[0002] The present invention relates to the field of content precaching in a 

networked environment; more particularly, the present invention relates to 
manipulating programs (e.g., scripts) in content objects to control their display. 

BACKGROUND OF THE INVENTION 

[0003] The World Wide Web ("web") uses the client-server model to 

communicate information between clients and servers. Web servers are coupled to the 
Internet and respond to docimient requests fi:om web clients. Web clients (e.g., web 
'^browsers") are programs that allow a user to simply access web documents located on 
web servers. 

[0004] An example of a client-server system interconnected through the Internet 

may include a remote server system intercormected through the Internet to a client 
system. The client system may include conventional components such as a processor, a 
memory (e.g., RAM), a bus which coupled the processor and memory, a mass storage 
device (e.g., a magnetic hard disk or an optical storage dislc) coupled to the processor 
and memory through an I/O controller and a network interface, such as a conventional 
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modem. The server system also may include conventional components such as a 
processor, memory (e.g., RAM), a bus which coupled the processor and memory, a 
mass storage device (e.g., a magnetic or optical disk) coupled to the processor and 
memory through an I/O controller and a network interface, such as a conventional 
modem. 

[0005] To define the addresses of resources on the Internet, Uniform Resource 

Locator (URL) system are used. A URL is a descriptor that specifically defines a type of 
Internet resource and its location. To access an initial web document, the user enters 
S| the URL for a web document into a web browser program. Then, a request is made by a 

flil 

client system, such as a router or other network device, and is sent out over the network 
to a web server. Thus, the web browser sends a request to the server that has the web 

m 

docimient using the URL. The web server responds to the request and sends the 
fill desired content back over the network to the requester. For example, the web server 
Q responds to the H)^erText Transfer Protocol (HTTP) request by sending the requested 
object to the client. In many cases, the object is a plain text (ASCII) document 
containing text (in ASCII) that is written in HyperText Markup Language (HTML); 
however, the object may be a video clip, movie or other bandwidth intensive content. 
[0006] A problem with the Internet is that it has limited bandwidth resources and 

different points in the Internet may experience network congestion, resulting in poor 
performance especially for bandwidth-intensive applications. The Internet backbone is 
often painfully slow. The bandwidth limitation is mainly due to one or more congested 
links between the web server and the client. Broadband access can help in solving the 
first mile problem but does not help if the congestion occurs deeper in the network. The 

Atty.Dkt.No.004781.P007 2 



"first-mile" is the first link from the server to the Internet. This can become a bottleneck 
if the content provider does not provision for sufficient bandwidth on this link or if 
there is a "flash-flood" of requests to the server. 

[0007] High-quality on-demand video over the Internet has been promised for a 

long time now. Lately, the hype has increased due to the emerging deployment of 
broadband access technologies like digital subscriber line (DSL), cable modems, and 
fixed wireless. These technologies promise to bring full motion, TV quality video to 
consumers and businesses. Unfortimately, early adopters of the technology quickly 
discovered that they still cannot get video in any reasonable quality over the network. 
Certainly, broadband access improves the viewing experience - some web sites targeted 
to broadband connected customers provide movies with slightly higher resolution. 
However, the video remains as jerky and fuzzy as before, synchronization with the 
audio is poor, and it requires often tens of seconds of buffering before starting. Nobody 
would seriously consider this to be an alternative to DVD or analog TV. 
[0008] Providing video over the Internet is difficult because video requires huge 

amounts of bandwidth, even by today's standards. MPEG4-compressed NTSC-quality 
video, for example, uses an average data rate of 1.2 Mbits/s, with peak rates as high as 3 
Mbits/s. MPEG2/DVD quality video consumes 3.7 Mbits/s on the average, with peaks 
up to 8 Mbits/s. 

[0009] Most of today's broadband Internet links, especially those to small to 

medium-sized businesses (SMBs) typically provide data rates in the 100s of Kbits/s up 
to 2 Mbits/s. Most residences get asynchronous digital subscriber line (ADSL) 
technology, which is typically provisioned at approximately 1 Mbits/s for downloads 

Atty.DktNo.004781.P007 3 



from the Internet, and 128 Kbits/s for uploads. Often access links are shared among 
multiple users, which further reduces the bandwidth available to an individual. 
[0010] While these data rates are expected to gradually increase in the long term, 

another phenomenon causing bandwidth shortage will remain: overprovisioning. 
Typically, Internet Service Providers (ISPs) overprovision their broadband links for 
economic reasons by a factor of ten. This means that if all their customers would use 
the service simultaneously, every one of those customers would get only 1/lOth of the 
bandwidth they signed up for. While this scenario might sound tinlikely, it is 
important to note that bandwidth will degrade during peak hours. The problem is 
better known from cable modems, where customers share a cable segment, but applies 
to all broadband access technologies. 

[0011] The network backbone can also be the bottleneck. Especially backbone 

peering points are likely to impose low data rates, which slows down end-to-end 
network speed despite fast last mile technology. Even technology advances such as 
terabit routers, dense wave division multiplexing (DWDM), and faster transmission 
equipment will not help significantly if, as expected, Internet traffic continues to keep 
growing faster than these advances in technology. 

[0012] One prior art solution to accommodate the slowness of the Internet 

backbone is to move content closer to individuals desiring the content. To that end, 
content may be cached on the carrier edge and requests for such content may be 
serviced from these caches, instead of the web server servicing the requests. 
Distributing content in this maimer can require large numbers of cache memories being 
deployed at the carrier edge and each cache memory stores content from a number of 
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sites. When a request is made for content jfrom a site that has been stored in one (or 
more) of the cache memories that is closer (from a network proximity viewpoint) to the 
requester than the original website, the request is satisfied from the cache. In such a 
situation, the interactive experience for text and images is improved significantly only if 
content from the site has been stored in the cache and the individual making the request 
is close enough to one of the servers supporting such a cache to satisfy requests with the 
content stored therein. This is referred to as carrier edge caching. One provider of such 
a service is Akamai. Also, such an arrangement for caching content requires that the 
content owner and the entity caching the content enter an agreement with respect to the 
access for that content so that the content can be stored ahead of time. Some of the 
providers of a carrier edge caching service use dedicated links (e.g., via satellites) to 
feed web pages and embedded objects to these servers and circumvent the Internet 
backbone entirely. Providing carrier edge caching for high-resolution video requires a 
particularly large number of servers to be deployed, since the nimiber of clients each 
server can handle simultaneously is very small. 

[0013] While carrier edge caching takes the load off the backbone and has the 

potential to significantly improve the end user's experience for text and image-based 
content, there are two major shortcomings with this approach. First, it requires 
hardware infrastructure to be deployed on a giant scale. Without servers in all major 
ISP's point of presence (POPs) and satellite receivers in central offices (COs), caching on 
the carrier edge does not work effectively. To deploy and maintain this hardware 
infrastructure is very cost intensive. Second, the last mile access link remains the 
bottleneck for affordable truly high resolution video for the foreseeable future. 
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[0014] Thus, high-quality video-on-demand in the strongest sense of the word 

might be something that will not be available for a while. However, despite all these 
limitations, a broadband access link of 500 KBits/s can deliver more than 5 GByte of 
data in 24 hours, which corresponds to 8 hours of NTSC quality video, or 3 hours of 
DVD quality video - more than most people, especially at work, ever watch. 
[0015] Another problem with providing content over the Internet is that a 

content provider is limited in only being able to display the content in one way and 
without any insight into what content is already cached at a particular client. This may 
limit a content provider's ability to control tlie number and order in which those 
content objects are displayed as that is under the control of the browser. This is of 
significance when the content provider only desires to allow display of content to which 
an individual has subscribed. 
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SUMMARY OF THE INVENTION 



[0017] 



A method and apparatus for processing content objects prior to their 



display is described. In one embodiment, the method comprises a client receiving a 
content object over a network connection; the client, prior to allowing the content object 
to be dynamically displayed, examining the content object and changing a portion of 
the content object to reflect information stored locally to the client, and dynamically 
displaying the content object changed based on the local information at the client. 
[0018] Other features and advantages of the present invention will be apparent 



M from the accompanying drawings and from the detailed description that follows below. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[00191 The present invention will be understood more fully from the detailed 

description given below and from the accompanying drawings of various embodiments 
of the invention, which, however, should not be taken to limit the invention to the 
specific embodiments, but are for explanation and imderstanding only. 

[0020] Figure 1 illustrates a flow diagram of one embodiment of a process for 

manipulating content objects to control their display. 

[0021] Figures 2, 3, 4, and 5 illustrate embodiments of a precaching architecture. 

[0022] Figure 6 is an exemplary protocol to facilitate precaching. 

[0023] Figure 7 is a block diagram of one embodiment of a computer system. 
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DETAILED DESCRIPTION 



[0024] 



A method and apparatus for processing content objects prior to their 



display is described. In one embodiment, the method comprises a client receiving a 
content object over a network cormection, the client, prior to allowing the content object 
to be dynamically displayed or stored, examiiung the content object and changing a 
portion of the content object to reflect information stored locally to the client, and 
dynamically displaying the content object chcinged based on the local information at the 
client. 

[0025] The content objects may include web pages, video files, audio files, source 

code, executable code, programs (e.g., games), archives of one or more of these types of 
objects, databases, etc. A chapter, for purposes herein, is a set of content objects 
classified according to content. 

[0026] In the following description, numerous details are set forth. It will be 

apparent, however, to one skilled in the art, that the present invention may be practiced 
without these specific details. In other instances, well-known structures and devices are 
shown in block diagram form, rather than in detail, in order to avoid obscuring the 
present invention. 

[0027] Some portions of the detailed descriptions that follow are presented in 

terms of algorithms and symbolic representations of operations on data bits within a 
computer memory. These algorithmic descriptions and representations are the means 
used by those skilled in the data processing arts to most effectively convey the 
substance of their work to others skilled in the art. An algorithm is here, and generally, 
conceived to be a self-consistent sequence of steps leading to a desired result. The steps 
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are those requiring physical manipulations of physical quantities. Usually, though not 
necessarily, these quantities take the form of electrical, magnetic, or optical signals 
capable of being stored, transferred, combined, compared, and otherwise manipulated. 
It has proven convenient at times, principally for reasons of conunon usage, to refer to 
these signals as bits, values, elements, symbols, characters, terms, numbers, or the like. 
[0028] It should be bome in mind, however, that all of these and similar terms 

are to be associated with the appropriate physical quantities and are merely convenient 
labels applied to these quantities. Unless specifically stated otherwise as apparent from 
the following discussion, it is appreciated that throughout the description, discussions 

V 

utilizing terms such as "processing" or "computing" or "calculating" or "determining" or 
"displaying" or the like, refer to the action and processes of a computer system, or 
similar electronic computing device, that manipulates and transforms data represented 
as physical (electronic) quantities within the computer system's registers and memories 
into other data similarly represented as physical quantities within the computer system 
memories or registers or other such information storage, transmission or display 
devices. 

[0029] The present invention also relates to apparatus for performing the 

operations herein. This apparatus may be specially constructed for the required 
purposes, or it may comprise a general purpose computer selectively activated or 
reconfigured by a computer program stored in the computer. Such a computer 
program may be stored in a computer readable storage medium. A machine-readable 
medium includes any mechaiusm for storing or transmitting information in a form 
readable by a machine (e.g., a computer). For example, a machine-readable medium 
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includes read only memory ("ROM"); random access memory ("RAM"); magnetic disk 
storage media; optical storage media; flash memory devices; electrical, optical, 
acoustical or other form of propagated signals (e.g., carrier waves, infrared signals, 
digital signals, etc.); etc. Each may be coupled to a computer system bus. 
[0030] The algorithms and displays presented herein are not inherently related to 

any particular computer or other apparatus. Various general purpose systems may be 
used with programs in accordance with the teachings herein, or it may prove 
convenient to construct more specialized apparatus to perform the required method 
. steps. The required structure for a variety of these systems will appear from the 
description below. In addition, the present invention is not described with reference to 
any particular programming language. It will be appreciated that a variety of 
programming languages may be used to implement the teachings of the invention as 
described herein. 

Overview 

[0031] A method and apparatus for processing content objects prior to their 

display is described. Figure 1 is a flow diagram illustrating one embodiment of a 
process for manipulating content objects. The process may be performed by processing 
logic that comprises hardware, software, or a combination of both. 
[0032] Referring to Figure 1, the process comprises processing logic (e.g., a client) 

receiving a content object over a networlc connection (processing bloclc 101). As 
described in more detail below, in one embodiment, the content object may come from a 
content provider or another peer. 
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[0033] Processing logic (e.g., the client), prior to allowing the content object to be 

d)aiamically displayed or stored, examines the content object and changes a portion of 
the content object to reflect information stored locally to the client (processing block 
102). The information may comprise a profile and/ or an indication of whether one or 
more other objects are fully or partially available on the client. 
[0034] In one embodiment, an agent (e.g., middleware) running on the client 

changes the content object after determining that a client has subscribed to this content 
object or one or more additional objects or knows a certain object or objects, or portions 
thereof, are in the cache of the client. For example, the agent may change a program 
(e.g., script) in an HTML document which causes a web page to be displayed in a 
certain fashion (e.g., only showing content objects already in the client's cache or only 
those subscribed to). In another example, such a program change may cause the agent 
to embed an object in another page to display a content object to an individual if that 
the individual has subscribed to it. 

[0035] In one embodiment, an agent on the client changes the content object by 

replacing at least one string in the content object based on the information stored locally 
to the client. The string may be a portion of a program (e.g., script). In one 
embodiment, the content object includes a program that uses the information to indicate 
how the content object is to be presented or stored at the client and changing the 
content object comprises modifying the program to change a representation of the 
content object. The local information upon which a change in the content object is 
based may be whether an individual is subscribed to one or more other objects and/or 
whether one or more other objects are stored in a cache of the client. 
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[0036] Processing logic then dynamically generates a display with and/or of the 

content object based on the local information at the client (processing block 103). In one 
embodiment, the content object is displayed using a browser. 

One Embodiment of An Architecture for Content Precaching 
[0037] The teachings described herein may be utilized in a networked 

environment that supports content precaching. Figure 2 illustrates one exemplary 
embodiment of an architecture for content precaching. Referring to Figure 2, one or 
more content providers (e.g., web servers, video servers, audio servers, etc.) 202 are 
coupled to the Intemet 206 or another networked environment. One or more clients 203 
is coupled directly to Intemet 206, or indirectly coupled to Intemet 206 through a client 
appliance 205. 

[0038] Clients 203 or 204 may comprise a PC, a work station, a network appliance 

device, a web pad, a wireless phone or other commimication device, a set-top box, etc. 
Client appliance 205 may be implemented on a service gateway (e.g., a router, bridge, 
switch, other network device) in the LAN or as an end point on the LAN. Clients 203 or 
client appliance 205 may nm software and reside in a LAN or other networked 
environment. In one embodiment, the precache memory is part of client 203. In 
another embodiment, the precache memory is part of client appliance 205, or on another 
client machine that is linked to client 203 by way of a LAN or some other networking 
subsystem. 

[00391 Client 203 or client appliance 205 may be coupled to the Intemet by a 

modem link, a digital subscriber line (DSL), cable modem, (fixed) wireless connection, 
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fiber, etc. This coupling may be either a direct connection, or indirectly connected 
through a router, switch, or other similar device. 

[0040] One or more clients may be peers. A peer is a "nearby" or local host, such 

as, for example, a host in the same LAN, a host connected to the same ISP, or any other 
networked device offering reasonable cormectivity (e.g., bandwidth, latency). In Figure 
2, any or all of clients 203 or client appliances 205 may be in peer relationships with 
each other. 

[0041] Master controller 201 is coupled to Internet 206 or some other networked 

envirorunent. In one embodiment, master controller 201 is a server host or cluster of 
server hosts along with storage (e.g., network-attached storage, database engines), and 
typically resides in a controlled envirorunent at one or a few locations strategically 
placed in the Internet to allow for reasonable connectivity. 

[0042] In one embodiment, the precaching described herein involves building a 

user profile, subscribing for update notifications for new content (e.g., objects) based on 
information in the user profile, downloading the new content, and intercepting user's 
requests for a web server to transparently return the content to the user. As described 
in more detail below, a user profile may be built by tracking user access patterns, 
receiving profile information from another entity, and/or being configured with a 
profile (or portion thereof) from a user. 

[0043] A client may subscribe for an update of new content based on information 

in the user profile. In one embodiment, periodic checking is performed to obtain an 
update of new content and includes sending the requests to the controller, which 
determines if there are any new content objects that correspond to content specified in 
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the profile. A determination of whether new content exists may be performed by 
querying a master controller, subscribing with the master controller, and/or crawling 
the networked environment. Each of these will be described in more detail below. 
[0044] In one embodiment, to facilitate the precaching process, the master 

controller maintains one or more databases of available objects and the locations of the 
objects. As new content becomes available, the controller searches the database of client 
profiles to determine the set of clients that will want a copy of the new content. The 
controller sends a message to each of the clients in the set to instruct them to download 
the content. The message contains the location from where an object may be 
downloaded to the client making the request. When the content has already been 
downloaded by a peer client, the controller may indicate to the client making the 
request that the peer client has the content and provides an indication to allow the 
requesting client to download the content from the peer client. Thus, in such a case, 
there is peer-to-peer precaching. 

[0045] In an alternative embodiment, the controller checks for new content, in 

response to a request by a client, by searching one or more database(s) to determine if 
the content object has been already downloaded by a client in the system. 
[0046] In one embodiment, the clients run on a platform and maintain profiles. 

A client may be an end point of a network or one or multiple hops away from the end 
point of a network (e.g., a local area network). By forwarding its profile to the 
controller and having the controller indicate when to download new content objects, the 
client is able to obtain and precache content objects prior to web browser or other end 
user program requests based on profiles. The content objects are downloaded and 
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stored in a precache memory when the network access link is not being used 
interactively. 

[0047] When a web browser or other end user program makes a request for a 

content object, the client intercepts the request and checks to determine if it has the 
content object stored locally. If it is stored locally, then the client obtains the content 
and sends the content object to the browser or other end-user program using any inter- 
process communication (IPC) mechanism; in doing so, the object may simply be 
transferred to another task, process, or thread running on the same machine as the 
client, or it may travel over a local network (e.g., LAN) to a different machine that is 
rimning the browser or end-user program. If the content object is not available locally, 
then the client retrieves the object, or a low-quality representation of the object, over the 
wide area network from any server which hosts the content object. 
[00481 Thus, each of the client's sends a profile to the master controller (NCXZ). 

The master controller gathers information about new objects being published and 
compares this to the profiles of each client to determine which objects the client's should 
download. The information of more objects being published may come from content 
servers. In other words, the master controller indicates to the client(s) when to 
download specific objects (and when to delete content). The master controller provides 
this indication in the form of download commands. In other words, after downloading, 
each client has a collection of cached objects sitting in its cache, which is managed by 
the master controller. 



Atty. Dkt No. 004781.P007 



16 



Discovery of Content 

[0049] Master controller 201 can discover content that becomes available at 

content servers 202. One way in which new content can be discovered is through direct 
reports 210 coming from content servers 202. Such direct reports 210 could be 
generated periodically, or in response to an event on server 202 (e.g., new content being 
placed on the server by the server administrator). Direct reports 210 are usually 
generated by software running on servers 202. 

[0050] Another way in which master controller 201 can discover the availability 

of content on content servers 202 is by use of a server appliance 207 that is co-located on . 
the server 202's site, or close to it. Server appliance 207 can locally crawl (220) through 
the content on server 202 frequently to check for the availability of new content. It can^ 
then report new changes, or provide a summary of all content on server 202, by sending 
messages 230 to master controller 201. In this context, the server 202 need not rim any 
special software that can communicate directly with the master controller. 
[0051] A third way in which master controller 201 can discover the availability of 

content on content servers 202 is by directly crawling (240) the content available on 
content server 202. This crawling operation 240 is similar to the way in which web 
search engines retrieve files from an Internet web server. 

[0052] Figure 3 is an alternative view of Figure 2 illustrating the gathering of 

profiles. Referring to Figure 3, clients 303 maintains profiles for local users. In one 
embodiment, the profile is built based on observing user access patterns, and from 
those access patterns, determining what types of content the end user will want to 
access in the future. In another embodiment, the profile may be built up or augmented 
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by information provided directly by the master controller 301 or the end users or both. 
A local network administrator may also add to the profile. 

[0053] Profiles for one or more clients 304 may also be maintained by a client 

appliance 305. In this case, it would not be necessary for clients 304 to run special 
software to collect and report profiles. 

[0054] Clients 303 report on the profiles they maintain to master controller 301 

using messages 310. Similarly, client appliances 305 report on the profiles they 
maintain to master controller 301 using messages 320. Messages 310 and 320 can be 
generated periodically, or in response to some event (e.g., a request from master . 
controller 301). 

[0055] Figure 4 is an alternative view of Figure 2 illustrating the initiating of 

downloads directly from the server. Referring to Figure 4, master controller 401 uses its 
knowledge of what content is available on content servers (as described in Figure 2), 
and its loiowledge of client profiles for different clients 403 and 404, to initiate 
downloads of content that will likely be needed in the future at clients 403 and 404. 
Master controller 401 sends messages 410 to clients 403 and client appliances 405 wliich 
contain commands to initiate downloads of content data from locations 402 specified in 
the messages 410. Clients 403 then send a message 420 to the content server 402 from 
which the content is to be downloaded. Content servers 402 then respond to these 
download requests 420 by returning the content data 430 to clients 403. Client 
appliances 405 retrieve content data from servers 402 in a similar mamner. 
[0056] Figure 5 is an alternative view of Figure 2 illustrating initiating downloads 

from peers. Referring to Figure 5, master controller 501 uses its knowledge of which 
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clients 503 and client appliances 505 have already downloaded specific content objects 
to initiate downloads of content directly from a peer client. In one embodiment, master 
controller 501 sends a message 510 to client 503.1 to initiate download of a content 
object from peer client 503.2. Client 503.1 sends a message 520 to peer client 503.2 to 
retrieve the specified content. Client 503.2 then acts as a content server by responding 
to request 520 by sending the specified content data 530 directly back to client 503.1. In 
another embodiment, master controller 501 can send a command to a client to upload a 
specified content object to a specified peer client; this is useful when the client sending 
the content data cannot be directly contacted by the requesting client, perhaps because 
it resides behind a firewall. Client appliances 505 can get content from peer clients 503 
and/or other client appliances in a similar manner. 

[0057] In an alternate embodiment of the invention, clients 503 or client 

appliance 505 may directly query the master controller 501 for new content objects that 
match their local profiles, and receive from the master controller 501 a list of the new 
objects that are available, as well as their locations (e.g., content servers 502, peer clients 
503, or peer client appliances 505). These queries may occur periodically or in response 
to some external event (e.g., a request from the master controller). Clients 503 or client 
appliances 505 can then select a suitable location to directly download the content from. 
In this embodiment, master controller 501 need not maintain profiles for all the clients, 
and messages 310 and 320 would be unnecessary. 

[0058] In one embodiment, master controller 501 loiows four things: 1) the 

content clients want based on profiles received from clients; 2) the new content that is 
available; 3) the location of the new content (e.g., servers, carrier edge caches, peers, 
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etc.); and 4) network information such as, for example, network connectivity (e.g., 
network topology information, bandwidth, delay, and dynamically changing snapshots 
of network congestion and /or utilization). Using this information, master controller 
501 schedules downloads of new content objects to clients 503 and client appliances 505. 
Such downloads may take the form of commands such as, for example, "get object from 
server 1" or may take the form of instructions such as, for example, "instruct client 2 to 
obtain the object from client 1". The network information and information about which 
downloads are taking place allow master controller 501 to do provisioning taking into 
account resource availability. 

[00591 In one embodiment, master controller 501 is able to coordinate downloads 

so that prior to a download of content completing to a particular client, another 
download of that content may start occurring form that particular client. This kind of 
pipelining of downloads can significantly reduce the delay before a content object is 
replicated to a potentially very large number of clients and/or client appliances. 
[0060] Clients 503 download content objects from the locations specified in 

messages 410 or 510 from the master controller. For example, in one embodiment, client 
503 may download bandwidth intensive content such as, for example, movies, video, 
software, images, sound files, etc. Client 503 stores the content locally in one or more 
precache memories. The precache memory may be part of a client 503 (or is at least 
accessible by it over a fast link, for example, over a LAN). The content may be 
downloaded on the end user's premises. In one embodiment, the downloading occurs 
without excessive interference with any other interactive network traffic. 
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[0061] A user request may be generated (e.g., from a web browser) to download 

specific content from the network. Client software running on an end system can 
observe these requests. Altemately, a client appliance can observe such a request 
originating from an end system to which it is connected (e.g., through a LAN). Clients 
or client appliances monitoring these requests can detect when the request is for a 
content object that is in the local precache memory of the client or client appliance. If 
such a request is detected, clients or client appliances can intercept the request and 
satisfy the request by returning the stored (precached) content object from its local 
precache memory. If the request is for a content object that is not in the precache 
memory clients or client appliances can forward the request on to their original 
destination (e.g., content server, carrier-edge cache, etc.). Thus, requests for a specific 
type of bandwidth intensive content are intercepted. In one embodiment, clients and 
client appliances are configurable to intercept requests for a certain type of content 
object. 

[0062] Thus, with content cached locally, clients and client appliances detect 

requests for embedded objects, check their precache memory to determine if the 
embedded objects are stored locally, and return the object from the precache memory if 
available. If the content is not available, the request is sent out into the network (e.g., 
Internet) to an appropriate location where the content or an alternate representation of 
the content may be foimd. 
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Presentation of Objects 

[0063] As discussed above, the techniques described herein allow for presenting 

information in useful ways to a user. In one embodiment, pages are generated 
dynamically using a local approach. In the local approach, the web page is dynamically 
generated based on information at the client. In other words, the resulting page that is 
rendered is based on local information, not content provider (e.g., server) information. 
The dynamic generation of the content object allows different versions of the object to 
be displayed based on the information at the client. For example, the page may only be 
displayed with objects that are already cached. For another example, the pages may be 
displayed with a particular logo on an object to indicate the object is in the cache or may 
have cached objects displayed differently (e.g., more prominently) than non-cached 
objects. 

[0064] In the local approach, the content provider supplies the web page. As the 

web page comes to the client, but before it reaches the browser, an agent rimning on the 
client (i.e., middleware) examines the web page and changes the web page to reflect 
information from the profile and the cached object(s). In one embodiment, the web 
page contains a program, or script. In one embodiment, the program may comprise 
Javascript or another scripting language. The program may comprise special macros, 
which will be replaced by an agent (middleware). These macros may comprise special 
strings. The agent changes the macros so that when the transformed macros reach the 
browser and are run by the browser, the browser can render the page based on the local 
state information, e.g., the contents of a profile, the set of available content objects, etc. 
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[0065] The agent stored on the client determines whether various objects are 

subscribed to and whether various objects are in the cache. The agent examines the 

special set of macros which are embedded as strings and searches the strings and 

replaces them with special values depending on the profile and the cached objects. For 

example, the agent may search for a string that indicates whether a content object is in 

the cache. 

String variables 

<script language = "Javascript"> 

if ("Jibe-is-Cached {objA}"=="yes") 

actions to be performed if content object A 
is present in the cache 

else 

actions to be performed if content object A is not in the cache 

</script> 

[0066] The agent searched for strings and replaces the entire string with a value. 

In the example above, the string "Jibe-Is-Cached {ObjA}" is replaced with "yes" or some 
other string. In one embodiment, the string is converted into a niunber. As shown in 
the script above that is included in a web page, if Jibe-Is-Cached {ObjA} has been 
replaced with "yes" then certain actions are performed (the browser will see the 
statement: if ("yes"=="yes"), which evaluates to "true"), while if the variable x has not 
been replaced with "yes" then certain other actions are performed (the browser will see 
the statement: if ("Jibe-Is_Cached {objA}"=="yes"), which evaluates to "false"). 
[0067] In one embodiment, HTML scripting languages are used. In such a case, 

the agent, if installed on a client, replaces certain patterns in an incoming HTML or with 
values that can be used in inline scripts (e.g.. Javascript) to render the page differently 
or take some other action based on whether the user is subscribed to a chapter (as 
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described in more detail below), or other content object, or whether an object is in the 
user's cache. In one embodiment, the following macros are replaced by the strings 



specified: 



Macro 


Value 


Jibe-Is-Installed{) 


Replaced with the string "yes" if the agent is 
installed and rurming 


Jibe-Version{} 


Replaced with the version number of the agent; 
valid nnlv if thp a^'Pnt is installed This mav Hp 
useful where different actions are to be taken by the 
agent depending on the version that is installed. 


Jibe-Is-Subscribed{cnn.com/sports /baseball} 
...the parameter is a chapter name 


Replaced with "yes" if the specified chapter is in the 

iiQpr's nrnfilp "nn" if if isn'f "iiTilmr»wn" if fKp n^crt^ 

UDCl. 9 L/XV/XXIC/ XIV/ XX XI XOXl UXl^llV/WXI XX UlC M^M^ 

does not belong to the site hosting the chapter (and 
is therefore not authorized to query the value of this 
variable). The use of "unknown" may be used in 
cases where one website (e.g., CNN) asks whether a 
chapter of another party (e.g., ABC) has been 
subscribed to. In such cases, the use of "imknown" 
prevents this information from being released to 
other such parties. 


Jibe-Is-Cached 

{http://cnn.com/sports/baseball/49ers.avi) 
...the parameter is an object name 


Replaced with fraction (0-1) of the object that is 
nrpspnt in rarhp "unknown" if thp nap"P dops nnt 

belong to the site hosting the object (and is therefore 
not authorized to query the value of this variable) 


Jibe-Local-Web-Port{} 


Replaced with the port nvmiber of the local (client- 
side) web server that handles confirmations for 
chapter subscriptions. In one embodiment, the port 
number is a service identifier to identify different 
services running on the same machine. The return 
value can be used by Javascript code to construct a 
local URL that the browser wiU be directed to in 
order to confirm subscription to a chapter. In one 
embodiment, this function of the content object is 

11_ ll-t'Til ■•• .11-1 

only be called if the agent is mstalled. 


Jibe-List-Subscribed-Chapters{} 


Replaced with a list of chapters separated by white 
space. 


Jibe-List-Cached-Objects{) 

Jibe-List-Cached-Objects 
{cnn.com/sports/baseball} 


Replaced with a list of cached object names and 
fraction cached separated by white spaces. 

e.g., objnamel 0.4 objname2 1.0 ... 

The parameter is used to limit the list to objects 
belonging to the specified chapter. The number 
following the object name is the percentage of the 
content object that is cached. 
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[0068] In one embodiment, these macros are embedded in a string value in 

scripts, and if the agent is not present on the client the variables remain imchanged (i.e., 
equal to their names). Below is an example (using javascript) of how some HTML can 
be added at a particular location in the document if an object is in cache. The effect of 
the code below is that a small icon will be displayed at the current location on the page 
if the object is in cache, and a different small icon will be displayed if it isn't. 

<script language="JavaScript"> 
if ("Jibe-Is-InstaUecH}" == "yes") { 

var is^cached = "Jibe-Is-Cached{http://cnn.com/sports/baseball/49ers.avi}"; 
switch (is_cached) { 
case "yes": 

document. write("<img src=*http://crm.com/cached-icon.jpg*>"); 
break; 
case "no": 

document. write("<img src= 'http://cnn.com/uncached-icon.jpg*>"); 

break; 
case "unknown": 
default: 

//do nothing 

break; 

} 

} 

</script> 

[0069] The above techniques are used by clients to dynamically generate web 

pages on the end system (client) (e.g., profile, cached objects). In an alternative 
embodiment, techniques described herein may be used to allow content providers to 
dynamically generate their web pages on the server. This is referred to herein as the 
server approach and is done by providing the content provider with information about 
the profile and the state of objects that are already in a client's cache. 
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A Server Approach to Control Display of Content: Sending "Contents of Cache" 
Information to Providers* Web Servers 

[0070] A server may respond to requests from web browsers rimning on various 

clients, some of whom may not house the precaching middleware and agent installed. 
In one embodiment, to distinguish between these clients, the server inserts a special 
header tag in its responses to these clients. In one embodiment, this tag would be 
represented as 

Jibe: Is-Installed 

in the user's responses sent using the HTTP protocol. These special header tags are 
described to be ignored by clients who do not have the agent installed. Clients that do 
have it installed, on the other hand, notify the server of its presence by sending the 
cookie 

Cookie: Jibe-version=1.0 
on every subsequent request to these servers. 

[0071] In the server approach, information is given to the web server which 

builds the web page (or other content object) dynamically on the server side. In such a 
case, the client does not have to do anything with respect to the page. In one 
embodiment, this is done by using cookies, specifically HTTP cookies in one 
embodiment. When a request is made by a client for a web page, the client sends a 
cookie as part of the request. The agent on the client inserts the cookies. These cookies 
may contain all types of information. In one embodiment, information that is sent in 
the cookies as part of the request includes the contents of the profile and an indication 
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of the state of the objects corresponding to that content provider that is cached on the 
client currently. 

[00721 In one embodiment, to reduce the amount of information that is sent, a 

mechanism called a "cookie prefix" is used. A cookie prefix represents a URL prefix. In 
such a case, information about each object that is associated with the cookie prefix is 
sent. An example of a cookie prefix is as follows: 

http/ /cim.com/baseball 
[00731 In one embodiment, each content object specification contains one or more 

Cookie-Prefix fields. Whenever the user visits a web page that has a URL whose prefix 
matches one of the specified Cookie-Prefixes for an object in the cache, the agent adds a 
special cookie to the HTTP request for that page. An exemplary cookie is given below: 

Cookie: Jibe-Object#http://x.tv/a.mov=0.5; Jibe-Object# http: / /x.tv/b.mov=1.0: 
[00741 The cookie indicates the name of objects that are cached on the client as 

well as the percentage of how much of each of the named objects are cached. For 
example, the exemplary cookie given above tells the server that 50% of the a.mov object 
is cached on the host, and 100% of the b.mov object is cached. Note that these cookies 
are only sent if the page being accessed falls under the Cookie-Prefix specified in the 
objects specifications for a.mov and b.mov. 

[0075] In other words, the agent inserts cookies in the request indicating that 

certain objects are in the cache, and these cookies are sent to the server, along with the 
request. In response, the server dynamically generates a web page based on the 
information about the client's profile and state of its cache, and sends it to the client. 
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Subscribing to Chapters 

[00761 In one embodiment, content providers can make a user subscribe to a 

chapter by providing a "subscribe" link on any of their web pages. In one embodiment, 
when a user clicks on a link, the client goes to the site and the site provides an 
indication of how to add a chapter to his/her profile. When the user clicks on this link 
to add a chapter to the profile, instead of going to the remote web site, the user is taken 
to the middleware agent rvmning on the same machine. This agent returns a page 
asking the user to confirm whether they want to subscribe to the chapter. The page 
may result in a pop-up dialog, or it could be a normal web dialog. When the user hits 
the "confirm" button, the chapter is added to the profile. 

[0077] An exemplary HTML construct for this link would have to be preceded by 

a special HTML comment line. In one embodiment, the HTML snippet is similar to this: 

<!" Jibe-Subscribe Chapter-Name="cnn.com/sports/baseball" 
[ Chapter-Title="CNN BasebaU" ] 

[ Chapter-Icon="http://cnnxom/iinages/sports-baseball-icon.jpg" ] 

[ Site-Title="CNN online" ] 

[ Site-Icon="http://cnn.com/cnn-logo.jpg" ] 

[ Cookie-Prefbc="http://cnn.com/sports/" ] 

[ Redirect-Qn-Confirm="http: / /cnnxom/ success.html" ] < 

[ Preferred-Server="hostl .cnn.com" ] 

[ Expires="Mon, 2 Feb 2002, 12:23:23 GMT" ] 

-> 

<a href="http://cnn.com/download-jibe-agent.htnil">Click here</a> to subscribe to the CNN 
Baseball chapter. 

[0078] Two cases are considered when the agent software is installed and 

rvinning, and when it isn't. If the agent is not rimning, then the browser sees the above 
HTML as is and the information in the HTML comment is ignored. When the user 
clicks on the link, he will be taken to the URL 

http: / / www.cnn.com/download-jibe-agent.htmL 
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[00791 On that page, the user is informed that the user needs to have the agent 

installed and running in order to subscribe to this chapter. The page has a link from 
where the user can download the latest version of the agent. This example assumes the 
content provider has set up a special page from which the user can download the agent. 
Alternatively, a default download page on a site may be set up to which any content 
provider can direct their viewers. 

[0080] If the agent is already installed and rimning, it modifies the URL in the 

subscribe link based on the information in the preceeding HTML comment. In one 
embodiment, it constructs a URL which points to the local agent and provides all 
information needed to complete the subscription. In response to the user's selection, 
the user is automatically taken to a local web page served up by the user's agent, where 
the user is asked to confirm or deny the subscription (and where the user can choose a 
weight for the chapter). If the user confirms the subscription by clicking on a "confirm" 
button on that page, the chapter is added to his profile, and the browser is sent a local 
web page (also served up by the user's agent) that displays a message confirming to the 
user that he has successfully subscribed to the chapter. 

[0081] In one embodiment, the local web page may also include a Redirect-On- 

Confirm field. If the Redirect-On-Confirm field is present, then this local confirmation 
page also contains HTML that automatically redirects the browser to the URL specified 
by the content provider in the Redirect-Qn-Confirm field. In case the browser does not 
implement this redirection (which is done in one embodiment using the meta http- 
equiv="refresh" mechanism), a link may be included on the local confirmation page 
which the user can click to be taken to the Redirect-On-Confirm page. 
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[0082] If the user rejects the chapter subscription request, the chapter is not 

added to his profile, and the user is taken to another local web page (again, served by 
the user's agent) which displays an appropriate message. 

[0083] In one embodiment, the Cookie-Prefix is used to specify when chapter 

subscription information should be sent back as a cookie by the agent for a given 
chapter. Thus, in the above example, if the user is subscribed to the chapter, then 
whenever that user visits any web page whose prefix is http:/ /cnnxom/sports/ , the 
web server receives a cookie of the form: 

Coolde: Jibe-Chapter#cnn.com/sports/baseball=l; 
[0084] If the Cookie-Prefix is missing, chapter subscription information for the 

chapter will not be sent in cookies. 

[0085] Use of cookies is completely optional however, and the content provider is 

not required to interpret any cooldes in order to make the system work for delivering 
content to their users. 

An Exemplary Protocol 

[0086] Figure 6 illustrates one embodiment of a protocol for exchanging 

information between master controller 501 and a client, a server, and a peer. Referring 
to Figure 6, initially, when the client first boots up, the client registers (601). 
Registration by the client involves sending information to enable master controller 501 
to coordinate the precaching activity. 

[0087] In one embodiment, once registration has been completed, all but one of 

the remaining operations are controlled from master controller 501 (e.g., in response to 
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a NOC request or message). Thus, master controller 501 sends a request to which the 
client replies, with the exception of one situation. 

[0088] After registration, master controller 501 requests the profile from the client 

(602). In one embodiment, master controller 501 indicates the size of the profile it is 
willing to accept or is able to accommodate. Then the client sends the profile to master 
controller 501 (622). In one embodiment, the profile is a list of links (e.g., 50 to 100 
URLs) in order of access frequency, with links that are accessed more often being at the 
top of the profile. If the profile is larger than the maximum specified by master 
controller 501, the profile may be made smaller by the client by removing links that 
have been accessed less frequently (e.g., that are at the bottom of the list of links). 
[00891 Similarly, master controller 501 commimicates with the web servers (e.g., 

content providers). A server registers with master controller 501 (603). In response to 
the registration, master controller 501 requests state information from the server (604). 
This request may be generated by master controller 501 periodically while the server 
remains registered. In response to the request, the server sends state information (605). 
The state information may include a listing of all content objects that are linked through 
the sites. The list may be limited to only those content objects that are rich media 
objects or bandwidth intensive objects in terms of downloading. Every time new 
content is added or removed, the server sends an add message (606) or a remove 
message (607) to master controller 501 to update the list (e.g., in a database) master 
controller 501 maintains of the content objects linked through the site. 
[0090] In one embodiment, master controller 501 initiates one or more 

maintenance tests on the client (621). These tests are well-known in the art. For 
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example, master controller 501 can request traceroutes from this client to some other 
Internet address or a bandwidth test from the client to a different Internet address. 
Master controller 501 vises these tests to determine network connectivity and resotirce 
availability. With this information, master controller 501 is able to obtain information 
about the network topology, a network map, etc., as listed above. Note that such 
information may be provided to master controller 501 directly without the need of 
testing to discover it. At this point, master controller 501 has information about 
network topology, information about server size state, and information about clients. 
[0091] In one embodiment, master controller 501 may send a reset cache message 

(609) if a cache checksum doesn't match a previously defined or calculaited value. 
[0092] Master controller 501 keeps track of where the content is. Specifically, 

master controller 501 keeps track of a particular content piece (e.g., video clips) and the 
identity of the servers and /or clients on which it is located. Occasionally, master 
controller 501 determines that a client is to download some object from a location and at 
this time, master controller 501 sends an initiate download message (610) to the client 
that identifies an object and the object's location. In one embodiment, the initiate 
download message includes the name of the object (e.g., imiversal resource identifier 
(URI) and its natural location (e.g., a URL corresponding to its location on the server of 
its origin, a URL corresponding to some peer client, etc.)). 

[0093] In response to the download message, the client initiates the download by 

sending a get data command to a peer (611). After the peer begins to send the data 
(623), the client sends a message to master controller 501 indicating that the download 
has started (612). The download may take a while. Once the download has been 
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completed, then the client sends a message to master controller 501 indicating that the 
download has been completed (613). This allows master controller 501 to know which 
downloads are occurring at any time. 

[0094] In case the peer is behind a firewall, then the client cannot connect to the 

peer directly and download the data from behind the firewall In that case, master 
controller 501 sends a message (615) directly to the peer to indicate that the peer is to ^ 
upload the new content to the client. Master controller 501 also sends a message to the 
client to expect an upload (614) from some peer. A particular session key or number 
may be used to correlate uploaded information received by the client from other peer 
clients with the correct download identified by master controller 501. The peer sends 
the upload (616). Finally, the client sends a heartbeat message (617) to master controller 
501 so that master controller 501 knows that the client is up in and running. 
[00951 In one embodiment, the messages are small. Therefore, because almost all 

requests come from master controller 501, master controller 501 is able to schedule all 
the downloads to ensure that no single client or network link is being overloaded. 

Building User Profiles 

[0096] The client creates a profile for an end user that is coupled to the client. 

The profile may comprise a list of resource locators (e.g., URLs), object type, object size, 
and a time stamp associated with the URLs to provide information as to when the end 
user accessed the resource. In one embodiment, the profile comprises URLs and access 
times, identifying web sites or portions of web sites, and when the user tends to access 
them. 
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[00971 The client may buUd the user profile in a number of different ways. In 

one embodiment, a user profile may be developed based on the user's browsing 
patterns. The client tracks user's access patterns that may include tracking the web sites 
a user visits, the time a user accesses those sites, and/or the frequency of access may be 
identified and then used to define the user's browsing patterns. In one embodiment, 
combining this information with information about the average size of certain types of 
objects and the availability of bandwidth to any given site allows a determination to be 
made as to when to begin checking a site for new or updated content to ensure such 
content is available locally at.the time it is likely to be accessed. If bandwidth is 
available (e.g., during the night), then the system (e.g., the master controller , client, etc.) 
can check for updates more frequently. 

[0098] Profiles may be configured by, or built, using input from a network 

administrator or manager, such as master controller 501 in the NOC. For example, the 
master controller 501 could add or remove URLs and access times. To make a change to 
the profile, the client would be accessible via the network, such as by, for example, an 
Internet service provider (ISP), application service provider (ASP), or content provider, 
and the profile could be configured through that access. An example of its use might be 
where the ISP provides a service by which a video movie is provided once a day to an 
end user. The individual could choose to watch the movie or not because the movie 
would have been already downloaded. Profiles may also be configured by a content 
server or a content provider. 

[0099] Altematively, the profile may be manually set by an individual, such as, 

for example, the user. The user may provide the specific URLs and access times 
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manually to the profile. For example, if a user checks a set of web sites at a 
predetermined time during the day, the user can configure the network access gateway 
to access the web sites prior to that time each day to obtain updated or new content. 
Such additions to the profile augment the accuracy of the precaching. 
[0100] A profile may be developed for a user using a combination of two or more 

of these profile building methods. Further priorities can be assigned to URLs stored in 
the precache memory in case of conflicting access times. In one embodiment, user 
configured URLs have priority over learned URLs (developed from tracking user access 
patterns) and network administrator configured URLs (e.g., from master controller 501). 
[0101] Furthermore, priorities can be given to URLs in case of conflicting access 

times. For example, in one embodiment, user configured URLs can have priority over 
"learned" URLs generated from tracking user access patterns and externally configured 
URLs. 

[0102] In one embodiment, only one precaching client is nmrung on a system at 

any one time. An open application program interface (API) to the profile may be 
provided to allow third parties to add URLs to user profiles, to schedule downloads, 
and to use the services provided by the precaching architecture for their applications. 

Locating New Content 

[0103] In one embodiment, clients may check for new content by subscribing 

with master controller 501 in the NOC. Clients 503 can subscribe with master controller 
501 to get automatic notification when new content becomes available. This is 
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advantageous on large web sites with millions of clients because it reduces, or even 
minimizes, time and resources used in crawling. 

[0104] Using the information stored in the user profiles, master controller 501 

periodically checks for new content. To facilitate this, client 503 may have previously 
passed updates to its profile, such as shown as arrow 310 in Figure 3. Master controller 
510 maintains a list of web sites cind their embedded media objects. This list is compiled 
by using updated information from content providers 502, such as, for example, shown 
as arrows 210 and 230 in Figure 2, or by crawling web sites from the NOC, such as 
shown as arrow 240 in Figure 2. The crawling process is similar to the way in which 
some Internet search engines create indices of web pages. 
[0105] In one embodiment, content providers 502 support the system by 

periodically crawling locally all available web pages on their servers to look for new 
object content. This local crawl can be implemented by software, hardware or a 
combination of both. 

[0106] The content providers 502 provide a summary of changes to master 

controller 501. Altematively, such information may be provided directly to a client 
The summary information may comprise the link, time, type and size of each object. 
The summary may include a list of URLs for those objects. The master controller 
compares the content in the list with the profile information (e.g., the list maintained by 
the network access gateway) to determine what content has changed and therefore 
what content, if any, is to be downloaded. In one embodiment, the result of the local 
crawl is made available in a special file, namely an update index. Master controller 501 
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analyzes the update index to find the new download candidates. In one embodiment, 
content providers 502 manually build an update index. 

[0107] Master controller 501 collects and aggregates the summaries. In one 

embodiment, each content provider 502 sends the summary to master controller 501. In 
such a case, all the clients need only contact one server to download summary 
information for groups of participating content servers in the network. In one 
embodiment, master controller 501 may unicast or multicast the information to one or 
more clients 503. 

[0108] . In an embodiment in which clients maintain their own profile, such as 
described in U.S. Application Serial No. 09/566,068, entitled "Intelligent Content 
Precaching," filed May 5, 2000, assigned to the corporate assignee of the present 
invention and incorporated herein by reference, clients 503 directly crawl a web site and 
search for new content objects. Clients 503 perform a crawl operation by periodically 
checking web servers indicated in the profile for new or updated content objects that it 
believes end users or other local devices will be accessing in the near future. In one 
embodiment, in such a case, a client begins with a URL stored in the profile and follows 
links into web pages down to a configurable level. 

[0109] In one embodiment, the controller obtains the first page from the server 

and determines if any bandwidth intensive objects are present. In one embodiment, a 
bandwidth intensive object may be identified by its size. If bandwidth intensive, 
embedded objects exist, the controller determines if new versions are available and 
downloads them. When new content objects have been identified, the controller 
indicates to the client to download only the bandwidth intensive (e.g., large), new 
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content objects (as they become available). The content objects obtained as a result of 
crawling are stored locally. In one embodiment, the precache memory storing such 
objects also stores their URLs, data type, size, the time when the data was acquired and 
the actual data itself. This process is transparent to the network and no change is 
needed to the content servers or the network to operate the precaching client. 
[0110] In an alternative embodiment, each new and /or updated content object is 

downloaded independent of size (after determining if the content object is a new 
version). 

. [0111] Some or all of these crawling techniques may be used in the same 

networked environment. For example, client 503 may crawl one or more sites to 
determine if any of the content objects have changed, while receiving information from 
master controller 501 or web servers employing a mechanism to crawl their sites to 
identify updated or new content and while caches in the network or content servers 
provide updated and new content to the client 503. 

Downloading 

[0112] Master controller 501 in the NCXI maintains a database of available objects 

and their physical location. When a new object is available for downloading to client 
503, master controller 501 determines the most suitable location from which client 503 
may download the object. In one embodiment, master controller 501 does this by 
analyzing the database and the client's Internet protocol (IP) address, and relating this 
to network topology, map, and connectivity information known to it. A scheduler in 
the NCXI returns a download trigger to client 503. The trigger provides information to 
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enable client 503 to download the object. This trigger information, or pointer, may 
comprise a location and £in object name (e.g., URL). 

[0113] A requested object can be downloaded from a variety of sources, e.g. a 

peer, a carrier edge cache, or the original server. In Figure 5, arrow 530 represents a 
download from a peer. Management controller 501 determines the most suitable host 
based on parameters. In one embodiment, these parameters include peer-to-peer hop 
count and bandwidth. 

[0114] If no suitable peer is available (e.g., if the request is the first request for an 

object or if suitable peers are too far away), the object can also be downloaded from a 
server installed on the carrier edge if the content provider supports carrier edge 
caching. If there is no suitable peer and no cache can be foimd, the object is 
downloaded from the original content provider server 502. Client 503 downloads the 
object in the background without excessively interfering with interactive traffic, 
regardless of the location from which it downloads. 

Intercept 

[0115] In one embodiment, client 503 transparently analyzes the web pages 

downloaded by the end users and rewrites embedded URLs in web pages to point to 
the locally precached object instead of the original object. In rewriting URLs, specific 
marlcs (e.g. a different link color or an additional icon) for objects available in the 
precache can be added. When the user finally selects (e.g., clicks) on a link, the browser 
automatically loads the object from the precache instead of the content provider server. 
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[0116] Client 503 may intercept requests for content objects in different ways. 

For example, in one embodiment, client 503 monitors requests and when there is a 
request for a content object stored by (or for access by) client 503, it takes the request 
and responds to the request as if it were originally addressed for client 503. Thus, an 
end user generating the request receives the content object as if it had received the 
content from the original server hosting the content. This is one example of an implicit 
way to translate an access for a content object to a locally cached object. The 
interception of requests may be done explicitly where an end system is aware of the 
new location of the object (e.g., through DNS lookup). In one embodiment, client 503 
checks for certain types of requests, which correspond to content available in the 
precache memory (e.g., all *.mov files). If such a request is detected, the client searches 
the precache memory for the requested URL. 

Applications 

[01171 The peer-to-peer precaching technique facilitates provision of premium 

services, such as explicit downloads, mapped content, aggregated access statistics, etc. 
The premium service of explicit downloads is done by installing triggers to pull the 
customer's content (e.g., all new clips on a web site immediately go to all sites with the 
web site's URL in their profiles). 

[0118] Mapped content allows customers to offer dense content dedicated to 

precache-enabled users. In one embodiment, this is implemented by offering a separate 
high resolution file of a video clip which is not lirJced into any web page, but is 
available to the master controller when it checks a target web site for new content. 
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When the user clicks on a video icon on a web page, the transparent precache 
technology delivers the high resolution version instead of the potentially low resolution 
version. 

[0119] In aggregated access statistics, access statistics and user profile statistics 

are provided to content providers and distributors. For example, individual user access 
profiles on the customer premises are retained, with the statistics being reported. By 
only reporting the aggregated statistics, privacy concerns are avoided. 
[0120] Besides enhancing traditional web sites with high-quality video, the 

O 

^ precaching techruque can be applied in other areas, such as advertising, and DVD on 
m demand. Rimning decent quality video advertising over the Internet has not been 
^1 possible so far. A broadband connection can barely deliver a single low-quality video 
y Stream, and consumers would certainly not want video ads to eat up their interactive 
R|i bandwidth. Thus, advertisers are currently limited to using "banner ads," which are 
Q mostly implemented as blinking images (animated GEFs). With precaching, 

advertisements can be downloaded while the link is not used otherwise. Thus, full 
motion ads can be downloaded in the background, and embedded in web pages, 
without exhausting the interactive bandwidth. The peer-to-peer video precaching 
technique helps advertisers to succeed in their hunt for eye balls. In addition, the 
precaching technique allows the advertisers and content providers to retain their ability 
to keep track of the number of "hits" of the embedded ads. 

[0121] The precaching technique also makes online distribution of DVD video 

feasible. The hassle with late fees, midnight video store nms and rewinding charges 
would be avoided using an online renting model. MPEG2 video, the coding standard 
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used on DVDs, requires an average bandwidth of 3.7 Mbits/sec. The average length of 
a DVD movie is two hours. An average movie needs approximately 3.5 Gbytes of disk 
space. Over a 500 kbits/sec Internet connection, three hours of DVD-quality movie can 
be downloaded in 24 hours. If the connection is twice as fast (e.g., 1 Mbit/sec), three 
full DVD movies can be delivered over the Internet in a day. 
[0122] Thus, a technique of personalized content delivery using peer-to-peer 

precaching has been described. In particular, this technique saves content providers 
bandwidth on their server farms and carrier edge caches. It also improves the 
H interactive experience of a large number of web sites. While the previous discussion 
S;; focuses on clients nmning on end system PCs, the technique can be implemented to nm 

m in access gateways, home gateways, set-top boxes, etc. 

i 

An Exemplary Computer System 

nil 

y. [0123] Figure 7 is a block diagram of an exemplary computer system (e.g., PC, 

H' workstation, etc.) that may be used to provide one or more of the operations described 
herein. Referring to Figure 7, computer system 700 may comprise an exemplary client 
503 or server 502 computer system. Computer system 700 comprises a commimication 
mechanism or bus 711 for communicating information, and a processor 712 coupled 
with bus 711 for processing information. Processor 712 includes a microprocessor, but 
is not limited to a microprocessor, such as, for example, Pentium™, PowerPC™, 
Alpha'^,etc. 

[0124] System 700 further comprises a random access memory (RAM), or other 

dynamic storage device 704 (referred to as main memory) coupled to bus 711 for storing 
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information and instructions to be executed by processor 712. Main memory 704 also 
may be used for storing temporary variables or other intermediate information during 
execution of instructions by processor 712. 

[0125] Computer system 700 also comprises a read only memory (ROM) and /or 

other static storage device 706 coupled to bus 711 for storing static information and 
instructions for processor 712, and a data storage device 707, such as a magnetic disk or 
optical disk and its corresponding disk drive. Data storage device 707 is coupled to bus 
711 for storing information and instructions. 

[0126] Computer system 700 may further be coupled to a display device 721, 

such as a cathode ray tube (CRT) or liquid crystal display (LCD), coupled to bus 711 for 
displaying information to a computer user. An alphanumeric input device 722, 
including alphanumeric and other keys, may also be coupled to bus 711 for 
communicating information and command selections to processor 712. An additional 
user input device is cursor control 723, such as a mouse, trackball, trackpad, stylus, or 
cursor direction keys, coupled to bus 711 for communicating direction information and 
command selections to processor 712, and for controlling cursor movement on display 
721. 

[0127] Another device that may be coupled to bus 711 is hard copy device 724, 

which may be used for printing instructions, data, or other information on a medium 
such as paper, film, or similar types of media. Furthermore, a soxmd recording and 
playback device, such as a speaker and/or microphone may optionally be coupled to 
bus 711 for audio interfacing with computer system 700. Another device that may be 
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coupled to bus 711 is a wired/wireless communication capability 725 to communication 
to a phone or handheld palm device. 

[0128] Note that any or all of the components of system 700 and associated 

hardware may be used in the present invention. However, it can be appreciated that 
other configurations of the computer system may include some or all of the devices. 
[0129] Whereas many alterations and modifications of the present invention will 

no doubt become apparent to a person of ordinary skill in the art after having read the 
foregoing description, it is to be understood that any particular embodiment shown and 
described by way of illustration is in no way intended to be considered limiting. 
Therefore, references to details of various embodiments are not intended to limit the 
scope of the claims which in themselves recite only those features regarded as essential 
to the invention. 
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